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METHOD, APPARATUS, AND ARTICX.E OF MANUFACTURE FOR 
FACHJTATING RESOURCE MANAGEMENT FOR APPLICATIONS 
HAVING TWO TYPES OF PROGRAM CODE 

BACKGROUND OF THE INVENTION 

A, Field of the Inventtop 

This invention generally relates to memory matiagement for computer 
systems and, more particularly, to a methodology for managing memory resources 
for an application program having two types of program code, native code 
S executing directty in an operating eavironmeni and target code for execution by an 
abstract compatiog machine associated with the operating environment and 
responsible for memory management for both types of code. 

B. DescrintioTi o f the Related Ait 

Object-orLmted programmzng techniques have revolutionized the computer 
10 industry. For example sudi tedbmiques offer new methods fixr designing and 
implemjmting conq>uter programs using an application programming interj&ce 
(API) associated with a predefined set of "classes," each of which provides a 
template for I3ie creation of "objects" ghmTig certain attributes determined by the 
class. These attributes typically include a set ofdata fields and a set of method 
1 5 for manipulating the object 

The Javai^ Dcvelopmeot Kit (JDK) fiom Sun Microsystems, Inc^ for 
example, enables devdcpers to write object-oriented programs using an AH wilh 
classes defined using the Java™ piogranmdng language. The Java programming 
language is described, for example, in a text entitled "The Java Language 
20 Specification'* by James Gosling, Bill Joy, and Guy Steele, Addison-Wesley, 1996. 

The class library associated with the Java API defines a MerarcJiy of classes 
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with a child class (zL&., subclass) ichoitiiig attributes fields and methods) of 
its parent class. Instead of having to "omte all aspects of a piogram fiom sciatch, 
piDgraniiners can simply inchtdc selected classes fiom the API in their progiams 
and extend the functionality offered by such classes as required to suit the 

5 particularneeds of a program. This efEectively reduces the amount of efifoit 
generally required for software development 

ILe JDK also includes a compile and a runtime enviionraent with a 
virtual machine (VM) for executing programs. In general, software developeis 
write progiams in a progcanuning language (in this case the Java programming 

10 language) that use classes fiom the APL Using the compiler, developers conq>ile 
their programs into "class files" containing instructions for an abstract computing 
model embodied by the Java VM; these instruction are often called "bytecodes." 
The runtime enviiDnment has a class loader that integrates the class files of the 
application with selected API classes into an executable application. The Java 

15 VM then executes the application by simulating (or "interpreting") bytecodes on 
the host pperatnigsystem/coiiq>uter hardware. The Java VM thus acts like an 
abstract compxjting machine, recdving instmcdons fiom progcams in the form of 
bytecodes and int^fpreting these bytecodes. (Another mode of execution is "just 
in time** compilation in which the VM dynamically compiles bytecodes into so- 

20 called native code for &ster execodcxL) Details onthe VM for the JDK can be 
found hi a text aititled "The Java Virtual Machine Specification." by Tim 
Lindhohn and ftank YcUin, Addison Wesley, 1996- 

The Java VM also supports multi-threaded program execution. Multi- 
threading is the partitioning of a conq>uter program or application into logically 
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independent "threads^ of execution that can execute in parallel* Each thread 
includes a sequence of instructions to cany out a particular program task, such as 
a m^od for computing a value or for perfonning an input/output fun^ When 
employing a coinputer system with multiple processors, separate threads may 
5 execute concunently on eadi processor. 

Thus, object-oriented &ci]ities like the JDK assist both development and 
execution of object-oriented systems. First, they enable develops to create 
programs in an object-oriented programming language using an APL Second, 
they enable developers to compile their programs, and thirds they ficllitate 

1 0 program execution by providing a virtual machine implementation. 

However, object-oriented programs may not be suitable Sor all functions of 
a system or it may not be economically feasible to convert all of tiie programs in 
an existing legacy system into object-oriented programs. It may also be 
necessary, for a system having primarily object-oriented programs^ to use features 

IS of a platform's operating system doat are not available in inqilementations using a 
VM like the Java VM Fii3aUy,tl]»vi3tua3xxiachine implementation itself is 
generally not writtra in the language it executes but rather in the native code of 
the host machine. Thus, it is not uncommon for systems to have programs with 
'•native" and "nan-native" code. 

20 For purposes of this description, native code includes code written in any 

piDgramzning language that is flien con^iled to run on a oompatible opiating 
system/hardware configuration^ For example, native code in this context includes 
program code written in the C or programming language and compiled by an 
appropriate compiler for execution on a particular platfbim, such as a computer 
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39. TT.ecoxnputer^tead*lemediumofclahn35,wheidnfteso^eisa^ 
fist associated the native mstnictlons. 
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40. A computer-readable medium conteining iiistnictioiis to perfoim a meifaod 
for contiollmg a data procMsing system to manage memoiy resources 
•conesponding to objects in the data processing system, the method comprising: 
providing aprogram component including a set of instructions native 1x> 

5 the system; 

including in flie set of native instractiona an instruction to synctoonize a 

garbage collector with the set of native instructions; and 

preventing, in response to Ibe synchronize instruction, the garbage 
collector fiom permitting reuse of memory resources corresponding to a particular 
10 object until after operation of certain native instructions. 

41, Tiiecomputer-readablemediumofclaim 40, wherein the instruction to 

synchronize a garbage collector wifli the set of native instructions inchides 

setting an inconsistency bit in a data structure associated with the program 

componoit 

42. The oomputerHreadable medium of claim 40, wherein the method fcrther 
oompiises: 

signaling the garbage collector to peitmit reuse of memory resources 
coxresponding to aparticular object after operation of certain native instructions. 
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43. Thecomputei-nMdablenifidiumofclaim42,whe^ 
synchronize a gaibage coUector with the set of native insttuctions iiicludes 

setting an inconsistency bit in adatastroctiire associated with the program 

coicponeot. 

44. The oon?)Uter-readable medium of claim 42. whereda signaling the 
garbage collectofr includes 

resetting the incansisteaMy bit 
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45, A compute-readable medium containing instructions to p^ann a method 
for controlling a data processing system to manage memory resotarces 
coitesponding to otjects in the data processing system, the me^ 

providmg a program component inchidiog a set of instmctions native to 

5 fliesystoi^ 

including in the srt of native instructions an instruction to syncbnmize a 

garbage collector with the set of native instractions; and 

signaling fte garbage collector to postpone a start of a collection piocess 
until after operation of certain native instructions in response to the synchrraize 
10 instructioiL 
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46. A computer-readable medimncordaiiiingm^^ 

for conlrolliiig a data processing syst^ 

corresponding to objects in Ihe data processing system, the method comprising: 
executing a program componfint inclnding a set of instructions native to 
5 the system, the set including an instruction to maintain infomiation on use of a 
particular object; ood 

relocating another object based on an indication fiom a source that the 
particular object is no longer being used, the source being different from any 
source used to provide infimnation on use of objects associated with non-native 
10 instmctions of the program component 

47. The conq>uter-ieadable medium of claim 46, wherein ftie method fiirther 
compiises: 

updating a data structure referencing the relocated object with its new 
location. 
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48. A computer-readable medixtttt containing instnictloas to pexfonn a method 

for controlling a data processing system to manage memory resoinces 

coiresponding to objects in ttie data processing system* the method conqjrising: 

executiog a program component including instructions native to the system 
5 and instractions targeted to the abstract computing machine^ wherein the 
instructions include references to objects representing memory resources; 

managing object refeences fiyr the target instructions in a data structure; 

and 

managing object lefexeoces for the native instructions in a linked list 
10 distinct flom the data structure fior managing object references for the target 
instructions. 



49. The computer-icadable medium of claim 48, wherehi the m^od ihrfher 
comprises: 

invokiixg a garbage collection process to reclaim m^nory resources 
corresponding to objects based on information fiom both the data structure for 
S object references for the target instmctions and the linked list for object references 
for the native instructions. 
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50. Tte computer-readable xnediuin of 49, wherein invoking the garbage 
oollecttcm process includes 

TCcIaiining the m^oiy resources for a particular object when an indication 
exists that memory resources must be reclaimed to implement an instmctiom to 
S allocate another object a^d it is det^mined that the target instructions and ^ 
native instructions no bnger require the memory resources for the particular 
object 
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51. A syst^ for maoagziig menxoty resources corresponding to obj ects, 
corapdsing: 

means for executing a program component including a set of instructions 
nadvc to the system, the set including an instruction to maintain information on 
5 use of a particular object; and 

means for pemjitdng reuse of memoiy resources corresponding to the 
paiticulsr object based on an indication from a source tfiat the particular object is 
no longer bemg used, the source bang different from any source used to provide 
information on use of objects associated vnUi non-native instracdons of the 
10 program componeEnt 
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52, A memoty device encoded with a data structure used for mauagwg system 

resources for a thread executing in a computer and including a set of instructions 

native to the computer and a set of instructions targeted to an abstract computer 

machine operating in the computer, the data structure comprising: 

5 a first field with ao. identifier for a memory area for holding refisrences to 

objects used in the native instructions; 

a second field with an identifier for a difEerent mCTooiy area &t holding 
references to objects used in the target instructions; and 

an inconsistency bit tbat» when set» prevents a garbage collector fiom 
10 permitting reuse of m^nory resources corresponding to a particular object until 
after operation of certain native instructions. 
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haviog the Windows 95 opeiatmg system miming on an Intd Pentium processor. 

Native code is distmguisbable from the non-native code, which will be zefened to 

as "target coda," because while non-native code is foreign to a platfbim's 

operating system/hazdware configuratioti, its target for purposes of this description 

5 is an abstract computing machine, such as a VM, opiating on any compatible 

platform configuration. For example^ target code for the Java VM is generally 

written in the Java programming lai^guage. This combination of native and target 

code in fhe same application tends to complicate the management of memory 

resources (la, the allocation and deallocation of memory) for such systems. 

10 In practice, when an plication seeks to refer to an object, the corcputer 

must first allocate or designate memory for the object Using a "reference^ to the 
aUocatedmemoo^, the ^Hcation can then properly inanipukte the ob}e^^^ One 
way to implement a refer^ce is by means of a "pointer*^ or ^'machine address,** 
which uses multiple bits of information, however, other implonentations ore 

15 possible. Objects can themselves contain primitive data items, such as intpgers or 
floating point nmnbeis> and/or xefetmccs to other objects. In tiiis manner, a chain 
of references can be created, each reference pointing to an object which, in turn, 
points to another object Vfhsn rK> chain of TdSereace^ in an plication reaches a 
given object, the computer can deallocate or reclaim the corresponding memory 

20 for reuse. 

Memory reclamation can be handled e7q}licitly by the cqyplication program. 
This method, however, requires piogrammers to design programs to account for 
all allocated objects and to determine "wbsa the objects are available for 
reclamation. The alternative is to assign responsibility for memory management 
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values in the target code's Stack. However, there is no loiown mq)lemeQtati^ 
uses exact garbage coUection fiw- programs includi^ 
and altows the same level of flexiT>mty and to^^ 

Sun NCciDsystems, Inc. also developed an interface, called the Java™ 
5 Native Interfece (JNI)> for native program code executing within the Java VM- 
The JNl is comprised of a lihraiy of functions, la, an API, and developers of 
native code call upon these functions with references to them by name in the 
native code* The JNI fhnctions enable the Java VMs garbage collector to obtain 
certain inf or mation concerning the native code fi>r purposes of garbage coUectioxL 
10 Using XNI functions, for example, the native code can reference ejects in a heap 
managed by the Java VWs garbage collector. While the interface itsdf allows an 
implementation siqjporting exact garbage collection^ in the most common 
Implementation exact garbage collection is ixct possibleL This is because 
references are maintamed in the same stack used to hold references fiir ttie Java 
15 code and the Java VM uses an indicator in a special fiame of Java code stack to 
control garbage collection of the native code objects. This implemCTtation is 
satisfactory for conservative garbage collection but it does not prevent the 
^'leaking*' of direct object references outside the JNI stack fi^e. In other words, 
direct references to objects may be lost during a garbage collectiDn cycle when all 
20 oftherefiarences may not be located in the INI stack fiame. ConsequMtly, such 
an inaplementation of the JNI does not support an exact collectioin algoiiflmi. 

Hiere is, therefore, aneed for a mechanism that &cilitates flexible garbage 
collection for memory resources for an application havtog two ^rpes of program 
code, native code fimlliar to an operatmg environm^t and target code fbr 
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execution by aa abstract computix^ machine associated with the operating ■ 

envinmnetiL 

SUMMARY OF THE TN VENTTQN 

Methods, systems, and articles of maaufaeture consistent with the present 
5 inveation, as embodied and broadly described bedrein, manage memoty lesowces 
coiiesponding to objects in a system, by providing a piogram component 
including a set of iostructions native to the system. These instaiotions include an 
instruction to maintain information on use of a particular object and permit reuse 
of memoiy resources corresponding to the particular object based on an indication 

10 fix>m a source that the particular object is no longer being used, the source being 
diff^rat fiom any source used to provide information on use of objects associated 
with non^nativeinstmctionsofthe program component The system includes a 
runtime environment for executing the program cotnpancat and a garbage 
collector of the runtime environment is invoked to permit reuse of memory 

15 resources. Hie garbage collector may inq)lemait an exact garbage collection 
algorithm, Thesoon^may be a stacdc or linked list assodated with 
instructions* 

In another implementation, mCTiory resources cozresponding to objects in 
a sysban are managed by providing a program competent includix^ a set of 
20 instnicticns native to the system. These instrtictions include an instruction to 
syndbroni^e a gaxbage coUector with the set of native instruct!^ 
response to the synchronize instruction, the gaibage collector fiom permitting 
reuse of memory resources corrraponding to a particular object until after 
opetation of certain native instructions. Hie instructian to synchronise a garbage 
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coUector with the set Of native iMtractions may include settle 
bit in a data steucture associated with the program component 

In yet another implementation, memory resources corresponding to objects 
In a system are managed by receiving a program component inchiding instmctions 

5 °ativetothesy8temandinstructionstargetBdtoiiieabs(raotcomputingmachi^ 
wherein the instructions inohide references to objects representing memory 
resources, managing object references for the target instructions is a dala structure, 
and managing object references for the native instrnctious in a linked list disthict 
from the data structare for managing object rrfiereaces for flie tatget instructions. 
10 A garbage coUectioti process is invoked to reclaim mttnory resources 

corresponding to objects based on information fiom both the data structure for 
object references for the target instructions and the linked list for object references 
for the native instructions. The garbage collection process reclaims the memory 
resources for a particular object when an indication exists that memory resources 
15 must be reclaimed to implement an instruction to allocate another object and it is 
detenuned that the target instructions and the native instructioiffl no longer require 
the m^nory resources for the particular object 

BRBEF DESCRIPTION OF THE PRAWTNrss 
The accompai^Hng drawings, which are incorporated in and oonstimte a 
20 part ofthis specification, ilhistrate an inqilanentationofthe invention and, 

together with die description, serve to explain the advantages and principles of the 
invention. In the drawings, 
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FIG. 1 isablodcdiagramofaixexemplaiy system wiAwhichinethods, 
systems, and articles of manufectore oooastent with the invention may be 
impl^ented,' 

no. 2 is a blocdc diagtam showing data structures fiw a multi-threaded 
5 application consistent -with the present invention; 

HG. 3 is a block diagram showing a target stack and a native stack in 
accordance with the principles of the invention; 

HG. 4 is ablock diagram showing a stack map fer target code; 

na 5 is a block diagram showing a linked Kst of local roots created in 
10 accwdance with the principles ofthe present invention; 

FIG. 6 is a flowchart of flie procedure fi)r creating the linked list of FIG. 5 
in a manner consistent with the principles of the present inveation; 

FIG. 7 is a flowchart illustiating a first method for synchronizing 
inconsistent threads with gaibage collection in a manner consistent with the 
15 principles of ^e present invention; md 

FIG. 8 is a flowchart Showing the processing performed by a garbage 
collector in a manner consistent with the principles of the present invention. 

TOyrAH.Ti'.n nEscRlPnow I 
Referaice will now be made in detail to an implementation consistent witii 
the presoit invention as illvstrated in the accompanying drawings. Wherever 
possible, the same reference numbers will be used throu^ut file drawings and 

the following description to refer to the same or like parts. 
Introduction 
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Mefliods. systems, and articles ofmanufecture consistent with the present 
invention fecilitate a flexible ^ach for garbage coUection associated ^vifli the 

execution of systems having both native and target code by traddng objects 
referenced by each type of code in separate stacks. A stack obeys flie Last-In- 
5 Fiist-Out (UFO) model and holds local variables, inchiding references to objects 
m the heap. In contrast, "static" or global variables, which may also include 
references to objects in the he^. are managed outside the stack. The target code 
objects are identified using a map of object references in the stack for the target 
code, whereas objects referenced by native code are identified in the native stack 
10 using a linked list 

Additionally, garbage coUection is not permitted during native code 
operations to read or write data in object fields because, during such opaations, an 
indication exists tiiat such collectioa may be inaccurate and could possiT>ly feil to 

find and T^date object referraces in nathre code but not q)ecified as su<A in th^ 
1 3 native code stack and global variables. 

System ArohitBctiMe 

Figure 1 depicts an exemplary data processing system 100 suitable for 
practicing methods and implementing systems and articles of manufacture 
consistent with the present invention. Data processing system 100 includes a 
computer system 1 10 connected to a netwoik 170, siich as a Local Area Network, 
Wide Area Netwoilc. or the Inteznet. 

Conqjuter system 110 contains a main memory 120, a secondary storage 
device 130, a central processing unit (CPU) 140, an ii^ device ISO, and a video 
display 160, each of ^!i*ich are electronically coi^led to the other parts. Mafai 

12 
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memoiy 120 contains an operali^ system 128. a virtual machine (VM) 122, aad a 
mTilti-threaded program 124. An exemplary VM 122 forpuiposes of Ihis 
descriptionistlieJavaVMdescribedabov^ In «DcheKemplaiy implementations. 1 
the Java VM ia part of a rimtime «o«em. which also includes an API and oUier 
5 &cmes required fi>r running plications ustog the Java VM. 

One skilled in the ait wiU appreciate that although one implementation 
consistent wilh the present mvention is described as being practiced using the Java 
VH systems and methods consistent with the present iirvention may ^ 
practiced in different oiviromnente. inchidiiig Hiose compatible with the Java VM. : 

10 Also, allhougji aspects ofonein^lementation are depicted as being stored in 

memoiy 120, one skiUed in the art wiU appreciate fliat all orpart of systems and : 
methods consistent with the present invention may be stored on orread from other 
computer-readable media, such as secondary storage devices, Uke hard disks, 
floppy disks, and CD-ROM; a caaier wave received from a network such as the 
15 Intemet;orotherformsofROMorRAM. Finally, althow^ specific conq>on«ts 
of data processing system 100 have been described, one skiUed in the art wiU 
appreciate that a data processing system suitable for use with the sjtemplaiy 
embodiment m^ contam additional or different components. 

VM 122 includes a gaihage collector 122a. In one implementation, 
20 garbage collector 122a implements an exact garbage coUection algorithm. 

alttiough other algorithms maybe implemented without departing fiom the 
piindples oonsisteot with the preset invoition. 

For purposes of simpli^rtng the iUostration program 124 is shown with 
more than one thread of execution T„ and T„ altliough those skilled in the art 

13 
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wm ondeistand that each thread represents a piocess consisting of a set of 
program instructions executing in CPU 140. A single thread such as T. . may 
executeportionsofnativecodel24aandtaiBetcodel24b. Consequently, VM 

122 and gaibage<»Uector 122amuatmanagememoiyiesoiiicesfor both typeso 
5 code operatiiig in &e same Hiread. 

API 126 includes native interfece 126a and class hT)rarie6 126b. Class 
Ubraries 126b includes a set of classes, and developers can select classes for taiget 
code 124b. Native interface 126a indodes a set of functions, and developers can 
include in native code 124a calls to the native inter&ce 126a to efect various i 

10 ^^ODs, including memory resource management in a manner consistent with 
principles of ihe present invention. 

In general, native interface I26a includes instructions to perform two types 
offimctions. The first concerns managing a native stack associated wifli a thread 
of control includirig certain portions of native code 124a. These fenctions build 

and maintain a Indeed list structure within tiie native stack to identify aU stack 
entries containrngrefierences to objects. Garbage coUector 122a traverses the Kst 
to identify all such rejBarenced objects and, if an object in tiie heap is not 
referenced in the native stack or elsewhere, for example, in a global variable or a 
stack for the target code, tiien garbage collector 122a reclaims the olijecf s 
resources. The second set offimctions in native inter&se I26a enable native code 
devdopers to specify periods of time during execution of native code 124a fijr 
which garbage collection is not pennitted because, for ejcample, execution of a 

garbage oonection cycle may destroy objects for wMch references may exist 
outside of tiie known reference sources, including the native stack, global 
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variables, and target code stack, ormove such objecfe, updating only the known 

butnottheunknownrefetmces. IfgarbagecoUection were p««itted during such 

periods.thereisariskoflossofolgectshavingvdidreferencesand,^^^ . 
lata- pwogram executioii errors. 

5 ^I^^^AcotitainsadocwneatentitlBdthe-IXNlUsef'sGmde,"wliic^ ' 

details howto use an «emplaorinterfece consistent ivith the principles of the ] 

presentiaventionwithanimplementatiorioflheJavaVMhavir^acoUeotorth^ . 
uses an exact garbage collection algorithm. 
Stack Stnietnyffl 

VM 122 is responsible to ocecuting program 124 using CPU 140 in 
coiuunction with an operating system 128. In alternative configurations, aU w 
some of the fimctions of VM 122 may be incorpoiated in the operating system or 
CPU 140. To fecihtate program execution in a multL-flneaded feshion, VM 122 
maintains a thread element for each thread. As shown in Pig, 2, a fliread element 
246 includes two stacks 250 and 252 for managing execution of each type of code. 
For example, target stack 250 holds leferencea to objects in memory used by 
target code I24b and native stack 252 holds refereaoes to objects in memory used 
by native code 124a. Those skilled in the art will recogoize that implementations 
consistent with the principles of the present invention may involve intermingling 
20 tlie two stacks in a memory structure or use a single stack with appropriate 
designations to distinguish between portions of the stack used for target code 
versus those portions used for native code. 

Thread data el«nents are ^ically linked together by thread data 
stmctures, such as thread data stroodire 248. For example, thread 1 data stnictuie 
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248identiflesorpointstoalocatlonfethedatastmotureforanexttoe^^ By 
linking aU thread data elements togeflier, VM 1 22 may st^ fiom thread to thread, 
and access the data elements of each thread. 

VM 122 also maintaina global roots 260 and native global lools 262 
5 separate fiom the thread elements. Global roots 260 and native global roots 262 
contain variables accessible by all threads. Tlicse variables may inchide 
refraences to stored objects. 

Figure 3 is ablodc diagram showing a portion of thread data element 246 
of Fig. 2 in greater detaa Thread data elaneot 246 compxiscs thread data 
10 stmetUTB 248, target stack 250 and native stack 252. Thread data structure 24S 
inchides fields of in&imation for managing the data elements of the thread. For 
example, thread data structure 248 stores inconsistency bit 310, target code stack 

pointer 3 12, native code stack pomter 3 14, and next thread pointer 3 15. Thread 
data structure 248 may also store other information about the thread. 
15 Inoonsistency bit 3 10 is set wbttiev«- a thread is starting to enter a region of 

program code that may resuh in pointers bemg used in a manner incoDsfsteot wia 
the implemoited garbage conecti<ni algorithm. 

Target code stack pointer 312 points to target stack 250. Target stack 250 
stores information used during execution of target code of a particular thread. 
20 Similarly, native code stack pointer 314 points to native stack 252, which stores 
information used during execution of native code of a particular tinead. Target 
stack 250 and native stack 252 have similar structures. Target stack 250 
comprises flames 316, 318 and 320. Native stack 252 comprises flames 322 and 
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324. ^y^^^^Poin^3l5poim3tofte^^,t,^offbo^ 
thread, as esxplained with reference to Fig. 2. 

In erne ifflplemeatation, each stack fiame 316, 31 8 and 320 for target code 
indudes an ai^a for holdingWvariables, an invoking fiamepom^^^ amethod 
5 pointer, a program counter (PQ, and an operand stack, as shoivn in Whet, 
a target or native metl»d starts executing, a stack frame for ft^ 
ontheappropriatestadc The stack fiame holds variables used during CKecution 
of the method, including references to stored objects. 

A target method uses values in dttier flie operand stack or the local 
10 variables ofihe stack frame fiom which it is executing. For example, a target 

method might add two integers by pushing liie integers on the operand stack and 
tiienperfomiing an add bytecode which pops the top two items ofFthe operand 
stadc, adds fliem, arKl pushes tiie answer badk on. 

Each target code stack frame 320, 3 18, and 320 also contains an invoking 
15 fi^efliatponitstothepreviousstackfiameonthestack,amethodpointertiiat 

points to a method block associated with the method, and a program counter CPQ 
that points to the oumrait line of the method being executed. 

In contrast; native code stack 252 comprises a series of linked frames 322 
and 324, each of which holds local variables used by the native method executing 
out of the frame. As in target stack 250, native stack 252 contains local variables 
that reference stored objects. 

As target or native methods execute, VM 122 manipulates local variables 
referenoing stored objects, deleting references to stored objects when no longer 
needed by the method. Hven though an object is no longer needed, It StiU 

17 
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occupies spaoeintheheap. As more object references are deleted, the space 
occupied by lunised objects grows until there is no ^ace left in the be^ for 
allocating new objecte. To provide more space for object allocatioii. garbage 
collector 122a periodicaUy determines which objects are being referenced, and 
5 «<^aims the remaining space in the heap. The reclaimed space can then ' 
forallocatii^ space formoreobjeots. Garbage collector 122a detetmines which 
objects are being referenced by st^piiig through each thread data element 246 
using the thread data structure 248 of each element 

An object is usually considered refeenced if there is some path of pointera 
10 leading to flie object from roots located in variables of the program. The roots of a 
program at a given point in execution are comprised of the global (ie. static) 
variables of the program together with the local variables of any procedure or 
mefliod cunently bring executed at that ececution point. Thia includes, for 
example, global roots 260 and native global roots 262 of Fig. 2, and the local 
15 variables ofstaok frames 316, 318 and 320 of Fig. 3. 

It is generally not difiBcult to idftUify ihe static variables of a program, and 
trace objects from those containing poiatera because static variables implementing 
pointers generaHy ronain pointeis throughout execution. It can, however, be 
difficult to Identify which local variables contain pointers to objects as opposed to 
20 primitive values. 

To save stack space, for example, the slots in stack frames are somethnes 
reused. Consider a method "m" that has two subparts: a pointer-containing 
variable "p" that is used only during the first part, and an niteger-cootaining 
variable "i" ftat is used only during the second part. Since "p" and "i" are never in 
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use at the same time, a Single Slot V in a Stack frame for -ta* migto 
both. In such a situation, gatbage coUector 122a has difficolQr dt^tcnnining 
. whethatoconsiderslotVapomteroraprimitive. If it doe$ not consider V a 
pointer, and V aclaaUy does contain a pointer, the garbage coUeotor risks 
5 incoirectly recycling fbs object to which "s" points. 
Garbage Collection fny Target Cloriw 

To address this problem for taiget code, thiead element 246 has a 
coirasponding stack map, as shown in Fig. 4. To create a stack map for a method, 
the method is first scanned to find safe points for garbage collection. Typically, 
10 these garbage collection safe points are times of transition, such as at a call or 
backward branch instruction. Once a safe point is found, tht stack map defining 
all of the pointer locations is generated and assodated with that particular 
instruction. There&i^ when a safe poiiit is reached during execution, a gaibage 
collector can detemiine fiom&e stack map where eadi pointer is located in the 
15 stack firame at the time the respective instruction is executed. Using this 

information, flie garbage collector knows exactly where all pointers are located. 
Stack maps can be generated at any point before gaibage coUection. For example^ 
they can be goierated when the program is conqjiled or during program executioii. 

Figure 4 is a block diagram illustrating an exan^jle of a stacking, Ihtiio 
stack frame 410 associated with amethod of thread n, method pointer 412 points 
to method block 414. Method blodc 414 points to the method 416, whidi is tiie 
codeoflhemettxod. Mefliod block 414 also points to stack m^ data stmctme 
418. Stack mtq} data structure 418 con^iises program counter values 
come^onding to particular lines oftiie code in method 416. Each program 
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counter value is associated with a respective map in the set 420. Bach msp in the 
set of stack nu^s 420 specifies the stack slots or memory registers containing 
. references to heap-allocated objecis* For purposes of illustratian, eadi stack 
is divided into two sections, indicated by a heavy vertical line* Locations to the 
S left ofthe heavy line indicate slots (SI, S2^ S3, S4) in the stack fiaxn^ 
method, and locations to the right indicate registers (Rl, R2)< 

As described above with reference to Fig. 3, a PC is stored in each fiame, 
and is used to track the line cuirently beiz^ executed in the method corresponding 
to the stack frame. When the PC in stack 410 (not shown) equals line 10> stack 
10 map 422 defines which slots and registers have object pointers at tVtaf particular 
point in execution of method 416. Stack nxap 422 indicates that slots Si aiKi S4, 
and re^ster Hi, each marked by a "1,'* have a pointer when execntion of method 
416 is at program counter vahie 10. Slots S2 and S3, and register R2, each 
marked by an "O," do not contain pointers. Therefore, the garbage collector can 
IS determine precisely ^ere each pointer is located for method 416 by using the set 
of stack m^s 420. 

^WhGSi garbage collector 122a begins a garbage collection cycle, each 
thread is stopped and advanced to a safe point Once execution reaches the safe 
point, garbage collector 122a uses the stack msp associated with each me&od to 
20 detennine pointer locations with cesrtainty. 

To find the stack znap associated with a partiovilar method, garbage 
collector 122a first steps through each thread data structure to access the target 
stacks, and uses the method pointer in the stack fi:ame to access the correq)onding 
set of stack maps< Garble collector I22a then uses the stack map corresponding 
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to Ihe line of code at Mtich themethod was stopped to detenninetiie stack frame 

locations having pointers refeixnciag objects. Further details on the use of a stack 

map in this feshion for garbage collection can be fomd in O. Agesen, D. Detlefe, 
J.E.B. Moss, "Gaibage Collection and Local Variable Typ^Preoision and 

5 LiveriessinJavaTMVirtualMachines,"PioceedingsoftheACMSIGPL^'98 
Confisrence on Ptogramming Language Design and ImplementatiQn, ACM, 1998, 
pp. 269-279, which is incoiporated herein by reference. 
garbage CoHection for Native 

In contrast, garbage coUection for code operating out of a native stack in a 
10 manner consistent with the princq)les of the present mvenlion involves including 
in the native code calls to certain functions of native inter&ce 126a. Developers 
can modify existing native code to include the flmction calls; alternatively, th^ 
can write new native code with the jEuncti<Hi calls. For purposes of this 
description, fliere aie two types of flmction calls. The fiist conoems creating and 
15 mafntaininB a linked list in the stack jbr the native code identi^g all of the sbts 
for local variables containing references to objects in the heap. The second 
involves setting inconsistency bit 310. When set, this bit prcv^its gaibage 
collector 122a fiom executing during an "unsafe" period when not all local 
variables containing references to objects are identifiable. 
20 Linked List 

Figure 5 is a blodc diagram showing an implemeitation of a per-thread 
linked list of local roots created in accordance with the principles of the present 
invention. Stack 514 contains stack frames having slots used by native methods 
during execution of the methods. Slots B.D and F point to objects. Slot E points 
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torfotD,and«latCpointsto8totB. Native stack poiirter 5 12 points to stack 5 14. 

aiid l<x^ variables pointer CLW) 5 1 0 points to th. first W 
. list 

TUe linked list is fomjed by grouping each object pointer with a points to 
5 *»»eprcrvdoiisobjectpointerinthestack. thcrefoie.byuainstbevato^ 

510. gatbage ooUector I22a can determine exactly Uie location of the object 
pointer in slot F, go to the next location and trace slot E to the olaect pointer in 
slot D, and go to the next location and trace slot C to the object point® in slot B, 
Slot B is foUowed by A, which has a null value, indicating the end of the linked 
10 list In this way, the garbage collector can detennine the exact location of eadi 
pomter in the stadc 

Figure 6 is a flowchart showing how the linked list of Fig. 5 is created 
For purposes of dns description assume LVP 510 is pointing to slotD. l^on 
receiving a routine call fiom native code 124a that requires creation of a new 
IS object pointer, VM 122 uses code in native interface I26a to set the value of slot E 
to the value of LVP 510 (step 610). Thus, slot E now points to slot D. VM 122 
then initializes the slot for the pomter to the new object in tiie heap (i.e., slot F) by 
setting the slot to a null value (step 612). VM 122 then sets the value of LVP 510 
to the address of slot F (step 614), so that LVP 510 continues to pomt to the 
20 uppermost object pointer in the stack. Finally, VM 122 sets the value of slot F to 
the address of the object in he^ 524 (step 616). 

When the native routine is done with a local root, VM m,pops it off the 
top of the local roofs linked list by setting LVP 510 to the address of flie next 
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obje^ctpointerdownwaxdinthestadc Ihtheexanipleshown,LVP510wiUbeset 
to the value stoied in slot E, i-e., tbe address of slot D. 

Any global variables containing object referaices are also mauipuJated 
using a similar Hnked list structure. 

Obj ects in the heap can be accessed by means of direct and indirect 
pointers. A direct pointer is tbe same as a reference in a local or global variable 
and can be used in a program to access an object. In contrast, a» indirect pointer 
is apointer to a direct pointer. Consistent regions ofprogram code use only 
10 indirect pointeis to reference objects by means of direct pointers. To access an 
object, for example, to write a vake in a field of the object, the indirect pointer is 
"dereferenced," obtaining access to the direct pointer and thus access to tbe object 
itself Regions of program code during which objects are accessed by using direct 
pointers are "inconsistciit" regions because the dereferencing of an indirect pointer 
15 may copy a direct pointer vahxe into a location not known by the garbage collector 
to contain sudi a pointer. Thus, garbage collection is not pennitted during 
inconsistent regions of program code because it is not possible to detamine 
exactly which slots in the stack fiame are pointers to objects in the heap. If the 
garbage ooUector relocates an object (as is often flje case with a compacting 
20 gaAage collector, for exan^leX the coUector may firil to update direct point«ars 
that wete obtained by dereferencing indirect pointers to tbe new location of the 
relocated objects. Hius, to access an object for read or write purposes in a manner 
consistent with the present invention, garbage collection most be postponed until 
the access operation is completed. This is aoconrplished by including in ti>e native 
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• c»de a call to a GC synch routine of interface 126a to 5e*im^ 
thread data stractuie 248, indicating ihat the thread is now in an inoonsist«it 
regionandgaibagecoUectionisnotpennitted. For efficiency, the caU may be "in- 
line," meaning the program code for 4e called roirtine is actually included in the 
5 calling program instead ofreqniring the routine to be loaded from another 

location. Thfi GC synch routine synchronizes native code with garbage collector 
122a. 

Figure 7 is a flowchart illustrating a method for synchronizing inconsistent 
threads with garbage collectiott consistent with the principles of the present 
10 invention. When an inconsistent re^on of code is entered, the native code 

declares the thread inconsistent by calling a routine of interfece 126a to set the 

inconsistent bit 310 (step 710). 

VM 122 ibea dereferences the indirect pointer received in tiie routine call 
using interfece 126a (step 7 12) to obtain the value pointed to by the indirect 
15 pointer a.e.,1he direct pointer). After native code is through using the direct 

pointer assodaled with an indirect pointer, ttie thread consistency bit is reset (stq> 
71 8). A global flag is then checked, to determine whether a garbage collection 
was requested while to Ihe inconsistent region (step 720). If the global flag 
indicates that no garbage ooUection was requested, the process is exited. If the 
20 global flag indicates that gaibage coUection has been requested, VM 122 waits 
until collection is complete (step 722). 

Figure 8 is a flowchart showing the prooesshig perfermed by gaibage 
collector 122. For cjcample, when amefliod requests to allocate an object and the 
request cannot be granted because the heap is fhll, Ae thread must nm agaibage 
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coUection to find memoiy space to satisfy toe allocs^ Inresponsetoa 
garbage coUection request, garbage collector 122 first stops aU threads ciweiitly 
being executed (atq) 810). Garbage collector 122a then determines whether aU 
threads are oonasteot by checking the inconsistent bit 310 of each thread data 
5 structure 248 (stq> 812). If aU threads are consisteiit,g^ 
performed (step 820), after which the threads are restarted. 

If some threads are not consistcatf, garbage collector 122 raises a global 
flag (step 814) indicatrng to threads coming out of inconsistent regions that the 
thread should synchronize witti garbage collector 122 whm it comes out of an 
10 inoonsistrat state. CjaibagecoUector 122 then restarts the mconsistent threads 
(step 816) and waits until all threads are consistent (step 818). Upon all threads 
becoming consistent, garbage collecfflon is performed (step 820) aod the threads 
are restarted. 

Therefore^ threads may temporaiily eater an inconsistent region, whidi 
15 prevents garbage collector 122 ftom starting a collection cycle. 
CCTglysidn 

Methods, systems, and articles of manu&cture consistent vdth the present 
invention tiierefore fecilitate a flerible ^proach for garbage collection associated 
with the execution of systems having both native and target code and p«mit 
20 impl«neirtations using eitfier a conservative or exact collection algorithm. 

The foregoiAg description of an implementation of the invention has been 
presented for purposes of illustration and desmption. It is not eschanstive and 
does not limit the invention to the precise form disclosed. Modifications and 
1^ variations are possible in light of the above tcadnngs or may be acquired from 
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piactioing of the invention. For exaiople, the described implementation includes 

softvirare but the present inveolion may be implemented as a combination of 

hardware and software or in hardware alone. The invention may be iii4>le!mented 

with both otgect-orieiited and non*object-oiiented pxogratoming systems. The 

scope of the invention is defined by the claims and their equivalents. 
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WHAT IS CLAIMED IS! 

1 . A method for managing memory resources corresponding to objects in a 
system, comprising: 

executing a program component including a set of instructions native to 
the system, the set including an instruction to maintain infotrmation on use of a 
S particular object; and 

permitting reuse of m«noiy resources c(»cxesponding to ttie particular 
object based on an indication from a source that the particular object is no longer 
being used, the source being diffeTBot fiom any source used to provide 
infotmatian on use of objects associated with non-native instructians of the 
10 program componeixt 

2. The method of claim 1, herein the system inclttdes a runtime 
environment for executing the program component, and wherein pemiitting reuse 
of memory resources includes 

invoking a garbage collector of the luntime environment. 

3 . The mefliod of claim 2, wheran invoking a garbage collector includes 
impl^enting an exact garbage collection algorithm. 

4. Hie method of claim 1 , wherein permitting reuse of memozy resources 
includes 

xising a stack associated with ^e native instructions. 
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5 . The method of claim 1, wherein pOTnittiiig reuse of memory resources 

includes 

using a linked list associated with the nsctive instmctlons. 
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6. A mettwl for Tnfmflging memory tesources correspoiidipg to objects in a 

system, comprising: 

executing a program component including a set of instnidions native to 
the system, wherein the set of native instructions includes an instraction to 
5 synchronize a gaibage collector with the program component; and 

preventing, in response to execution of flie synchronize instruction, the 
garbage collector fiom permitting reuse of memory resources corresponding to a 
particular object until after operation of certain native inactions. 

7. The method of claim 6, wherdn the instruction to synchronize a gaibage 
collector with the set of native instructions includes 

setting an inconastency bit in a data stnicture assodated with the program 
componenL 

8. The method of claim 6, ftirther conqxrising: 

signaling the garbage collector to permit reuse of memory resources 
correspondiiig to a particular object after operation of certain native instructions. 

9. The mefliod of claim 8, wherdn the instruction to synchronize a garbage 
collector witti the set of native instructions includes 

setting an inconsistency bit in a data stmctuie assodated with the program 
component 
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10. The meOwdofclaim 8, wherein rignaling the gaibagecoUector^ 
resetting the inconsistency bit 
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11. A method for mai^giiig nuemoiy resources correspondiag to objects in a 

system, comprismg: 

providing a program camponent includiag a set of instructions native to 
ttie system, wherein the set of native instructions includes an instruction to 
5 synchronize a garbage collector with the program component; and 

signaling the garbage collector to postpone a start of a collection process 
until after operation of certam native instructions in response to the synchronize 
instruction. 



31 



APR. 25. 2006 10:20AM 1 6509618301 NO. 201.««yiP. 

wo 00/10090 

12. A memory for managing memory resonrcses oorrespotiding to objects in a 
system, the mraiory comprising: 

a of instractions native to the syst^, the set including an 
instruction to mflintaiT^ infoimation on use of a particular object; and 
5 an interface with code for pemiitting reuse of memory resources 

corresponding to the particular object based on an indication firom a 
source that the particular object is no longer being used, the source 
being different fiom any source used to provide information on use of 
objects associated with non-native instructions. 
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13, A camputer-iinplemented method for managing resources correspondiiig 

to objects in a menooiy, comprismg: 

executing a program conqxHieat including a set of instructjons native to 
the system^ the set including ati instruction to mflintain infcimation on use of a 
5 particular object; and 

relocating another object in the memory based on an indication from a 
source that the particular object is no longer being used, the source being differrat 
ftom any source used to provide infonnation on use of objects associated with 
non-native instructions of the program componeDt. 

14. The method of claim 13, further comprising: 

updating a data siru c tm ie referencing flie relocated object with its new 
location. 
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15. A meBiod for rnsm^^n^ memory lesoitcces corresponditig to objects in a 
system having an *stract computii^g machiM, compr^ 

executing a program component including first instructions native to the 
syst^ and second instructions targeted to the abstract computing madiine, 
5 wherein ttiej5ist and second instructions include referen 

memoiy resources; 

m^fl g iri g object references for the second instructions in a data stmctur^ 

and 

managing object references for tiie first instructions in a linked Kst distinct 
10 from the structure far managing object references for the second instructions. 

16, The method of claim 15, further conqmsing: 

invoking a garbage collection process to reclaim memory resources 
corresponding to objects based on in&imatian from both &e data structure for 
olgect refereoces for ^e second instructions and fhe linked list fotr object 
5 ref^ences for the first instructions. 

1 7. The method of 16, wherein invoking the garbage collection process 
includes 

reclaiming the manoty resources &r a particular object ^en an indication 
f^fftft thfl'*^ Tma-mftry nefiomces must be reclaimed to nerfoim an instruction to 
5 allocate anothw object and it is determined that the second instmctions and Ihe 

first instructions no longer require the memoiy resources for the particular object 
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18. A system for managing m^ory xesowces corresponding to objectSt 
compnsing: 

a m^oiy having a program componmt including a set of instructions 
native to the system, tkie set inclutog an instmction to maintain information on 
5 use of a particular object and 

a processor configured to permit reuse of memory resoiirces coirespon<^ 
to tiie particular object based on an indication from a source that the particular 
object is no longer being used, the source bdng diflferent from any source used to 
provide information on use of objects associated with non-native instructions of 
10 the program component 

19. The system of claim 18, wherdn the processor is flirthei: configured to 
invoke a garbage collector. 

20. The systOTi of claim 19, wheran the garbage collector implements an 
exact garbage collecdon algorithm. 

21. The system of claim 18, wherein the source is a stack associated with tiie 
native instructions* 

22. The system of claim 18, wh«xin the scmrce is a linked list associated with 
the native instructions. 



35 



APR. 25. 2006 10:20AM 16509618301 WNO. 20 1*'^*^?. 30/34 

wo 00/10090 

23. Asyst^formanagi^m^noxyrescn^cescoir^^ 

,p,oo«sor<=onfig»redto,«>rent. ini<«P<m«to«» sy^ 

insUactions, 

24. Thesystemofdaim23.Mtomtheproce^ 

25. The system of claim 23. wherm flie piocessor is further configuied to 
MgualthegaxbagccoUectortopeinritreuseofmemoTytesoiirc^ 
aparticularoldectafteropendimofcettaiixtiativeiD^ - 

26. TlxesystemofoldmlS.wherdxilhepiocessoriaf^^ 
an i^nd«t««:y bit in a data structure assoda^ 



27. The system 
the mconsistency bit 



o f claim 25 , wherein processor is ferfher configured to reset 
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28. AsfystemformanagrngmemoryTesouifcescoircspoii^ 

a memory having a program compottent incliidmg a set of instmctioDs 
native to the system, the set of native instiuctioiis inchiding an instructioii to 
5 synchronizeagaibagecoUeotorwiththesetofiiaiivemstm and 

a processor configm^ to signal the gaAage coUector to postpone a start of 
a coUection process mitil after op ecation of certain native instructions in response 
to the synchronize mstraction. 
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29. A system for managing memory resouxoeswiresponding to obj^ 
coomprising: 

a mcmoiy having a program componait inchidtog a set of instructions 
native to the system, the set including an instmction to maintain in&itnation oa 
5 use ofapaiticolar object; and 

a processor configured to relocate anoflier object based on an indication 
from a soutce that the particular object is no longer being used, the source being 
different from any source used to provide information on use of objects associated 
with non-native instaiotions of tbe program component. 

30. The system of claim 29, wherein the processor is further configured to 
update a data structure referencing the rdocatBd object with its new location. 

31. The system of claiin 29, wherein the processor is fiirthra- configured to 
invoke a garbage collector. 
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32- A system for managing memory resomcescoire^ 
having an ab^&act computing machine, comprising: 

a memory having a program component incltxding first instructions native 
to the system and second instructions taigeted to the abstract computing machine^ 
5 wherein the first and second instructions use references to objects reprraenting 
memory resources; and 

aprocessor configured to manage object references for the second 
instructions in a data stmcture and object references fi>r the first instructions in a 
linked list distinct fiom the data structure for managing object references fiar the 
10 target instructions. 

33, The system of claim 32, wher^n the processor is fiirther configured to 
invoke a garbage collection process to recOaim memory resources corresponding 
to objects based on infomiation fiom both the data structure for object referwces 
for the second instructions and the linked Kst for object refisrences for the first 

S instmctions. 

34. The system of 33^ whwdn the processor is further configured to reclaim 
the memory resources for a particular object when an indication exists that 
memoxy resources must be reobimed to implanent an instruction to allocate 
another object and it is determined that liie second instructions and the first 

5 instructions no longer require the memory resources to/r the particular object 
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35. A computer-ieadable medium containing instructions to perform a mdhod 
for controlling a data processing system tomanage mcanoiy lesouices 
conesponding to objects in the data procrasing system, the method oon^ 

executing a program component incltiding a set of iDStructions native to 
5 the system, the set including an instruction to maintain infi^^ 

particular object; and 

pennitting reuse of memory resources corresponding to the particular 
object based on an indication fiom a source liiat the particular object is no longer 
being used, the source being difieient fiom any source used to provide 
10 information on use ofotjectsassodated with noft-native instructions of the 

program component. 

36. computer-readable medium of claim 35, wherein the data processing 
system includes a luntime environment for executing the program component, and 
wherein pennitting reuse of memory resouices indudcs 

invoking a garbage collector of the runtime enviromnenL 

37. The oomputer'teadable medium of claim 36, whereiQ invoktog a garbage 

collector includes 

nnplemendng an exact garbage collection alg(»i1hm. 

38. iTie computer-readable medium ofdaim 35, wherein the source is a stack 
associated with the native instructions. 
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